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Abstract 

The purpose of this study is to develop a scale to measure fifth grade students' mathematical calibration skills. 
Besides, it aims to determine students' calibration skills through this scale. Results of the study revealed that 
fifth-grade students (n= 94) enrolling to study, have a medium-high Level of (M= 55.12, 5D- 21.76) mathematical 
calibration skills. Furthermore, the results showed that students' mathematical calibration skills do not show 
significant differences with respect to their gender )t=.501, p > .01). However, students' calibration skills show 
significant differences when considering their Level of mathematics achievement (F |2 91| —69.46, p <.001. i] 2 =.60). 
In addition, a positive and significant relationship was found between students' mathematical calibration skills 
and their mathematics achievement (r =.85, p <.001). 
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Calibration, which is one of the metacognitive 
control skills (Nelson & Narens, 1990), is defi¬ 
ned as the accuracy of learners’ perceptions of 
their own performance (Pieschl, 2009). For this 
reason, calibration is considered as a part of self- 
regulated learning process and it is related with 
monitoring skills which are reported among 
metacognitive control skills (Veenman, van Ho- 
ut-Wolters, & Afflerbach, 2006). Metacognitin 
refers to an individual’s awareness of his own 
thinking process and his ability to control these 
processes (Flavel, 1979). It is observed that mo¬ 
dern studies discuss the metacognition under 
three main facets: Metacognitive knowledge, 
metacognitive control and metacognitive expe- 
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riences (Desoete, 2009b; Efklides, 2008; Flavell; 
Karably & Zabrucky, 2009). To sum up, meta¬ 
cognitive knowledge defines, awareness of how 
an individual learns, awareness of methods and 
strategies which are effective for learning pro¬ 
cess, awareness of selecting useful information 
and strategies (Bembenutty, 2009; Flavell; Kra- 
marski, 2009; Sarac & Karakelle, 2012; Schraw & 
Moshman, 1995; Varsari, Battistelli, Cadamuro, 
& Farneti, 2009). 

Metacognitive control skills consist of leading 
mental operations in metacognitive proces¬ 
ses and can be defined as the ability to use the 
metacognitive knowledge strategically in order 
to attain cognitive objectives (Ozsoy, Memi§, & 
Temur, 2009). The literature focuses on four me¬ 
tacognitive control skills (Brown, 1980; Desoete, 
2009a; Desoete, Roeyers, & Buysee, 2001; Deso¬ 
ete, Roeyers, 8t Huylebroeck, 2006; Lucangeli & 
Cornoldi, 1997; Schraw, 2009; Schraw & Mosh¬ 
man, 1995); prediction, planning, monitoring 
and evaluation. 

Calibration involves monitoring and it emerges 
with the common use of prediction and evalua- 
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tion skills which are metacognitive control skills 
(Desoete et al., 2001). Thus, calibration clarifies 
individuals’ awareness of their own cognitive 
processes such as what they know and do not 
know or what they do and do not do (Stone, 
2000). This kind of accurate monitoring is con¬ 
sidered as a prerequisite for successful learning 
(Lin, Zabrucky, & Moore, 2002). On the other 
hand, literature reports that individual’s can 
better monitor their own cognitive abilities, and 
thus better calibrated, with increasing age (Hor- 
gan, 1990; Johnson & Wellman, 1980). Calibra¬ 
tion, is considered as one of the developmental 
changes depending on judgment of knowing 
(JOK) (Bembenutty, 2009; Cole, Martin, Peeke, 
Seroczynski, & Fier, 1999). Calibration is the ac¬ 
curacy between one’s own judgment about the 
performance and his/her actual performance on 
a task (Hacker, Bol, & Bahbahani, 2008). Thus, 
to measure calibration, it is preferred to com¬ 
pare the actual performance and the evaluation 
of his own performance (Lin & Zabrucky, 1998; 
Schraw & Moshman, 1995; Tobias & Everson, 
1996; Winnie &Muis, 2011). 

Measuring Calibration 

Previous research studies show that fundamen¬ 
tally two different approaches have been used 
to measure the ability of calibration. One part 
of these approaches (Glenberg & Epstein, 1985; 
Glenberg, Sanocki, Epstein & Morris, 1987), in 
order to measure the calibration, a correlation 
calculation between student’s performance on 
a standard test and his level of understanding is 
used. It is assumed that the closer the correlation 
to +1, the student is closer to a perfect calibrati¬ 
on and vice versa. On the other part, an instru¬ 
ment with four factors developed by Schraw, Po- 
tenza ve Nebelsick-Gullet (1993) have been used 
for calibration measurement. This approach, on 
the one hand, calculates the accuracy between 
the predicted and the real performance, on the 
other hand, calculates the internal validity of the 
instrument with bi-serial correlation and the 
alpha coefficient of the predicted and the real 
performance. According to Schraw (1995), the 
most consistent values for the calibration level 
is obtained by the comparison of the predicted 
and the real performance values obtained for 
each test items ( item-specific calibration). Total 
calibration score can be obtained by calculating 
the avarege of each test item’s calibration scores 
(Ramdass, 2009). In the present study, item-spe¬ 
cific calibration is used to develop mathematical 
calibration skills instrument. 


Purpose 

This research study has mainly focus on two po¬ 
ints. First of all, it aims to develop an instrument 
to determine mathematical calibration skills and 
secondly, it aims to determine fifth-grade stu¬ 
dents’ mathematical calibration skills using this 
instrument. In addition, students’ calibration 
skills are compared with respect to their gender 
and their mathematics achievement levels. 

Method 

The present study aiming to determine primary 
school fifth-grade students’ mathematical ca¬ 
libration skills was carried out through survey 
method. Survey method is an approach which is 
used to describe the past and the current situati¬ 
on as it is (Karasar, 2000). 

Participants 

The participants of the study consist of 93 fifth- 
grade students (mean age 11.1, SD = .57) from a 
public primary school in Aksaray, which is a me¬ 
dium-sized city in Turkey. Out of these students, 
54% of them were girls and 46% of them were 
boys The study carried out during the spring 
semester of 2011. The participants of the study 
selected through convenient sampling model. 

Mathematical Calibration Instrument 

Mathematical Calibration Instrument which is 
developed by the researcher is used to determi¬ 
ne students’ calibration skills. During the deve¬ 
lopment of the instrument, previously used app¬ 
roaches chosen to measure metacognitive skills 
(prediction and monitoring) are followed (Cross 
& Paris, 1988; Desoete et al., 2001; Lucange- 
li, Cornoldi, & Tellarini, 1998). The instrument 
includes 28 items covering measurement of 
prediction skills (14 items) and evaluation skills 
(14 items). Prediction and evaluation items are 
designed to be associated with each other (Ap- 
pendix-1). 

Mathematical operations and problems placed 
in the instrument are designed taking into ac¬ 
count the relevant achievements stated in Pri¬ 
mary School Mathematics Curricula (Ministry 
of Education/Milli Egitim Bakanhgi [MEB], 
2004). Pilot study was conducted under the su¬ 
pervision of the researcher with 158 fifth-grade 
students enrolling to two primary public schools 
located in the center of Aksaray. The reliability 
of the instrument was calculated as r = .93 (p 
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< .001), using Cronbach’s Alpha. On the other 
hand, in accordance with the data obtained from 
the preliminary application with 158 fifth-grade 
students, Kappa value is calculated to determine 
the internal consistency of the instrument. The 
results revealed that Kappa values of prediction 
and evaluation items change between .42 and 
.68. When Kappa values for all items are exa¬ 
mined, it is possible to say that the consistency 
between the prediction and the evaluation items 
range from medium (.41-.60) to high (.61-.80) 
levels. Kappa values for each item are presented 
in Appendix- 2. 

Mathematical Achievement Test 

Mathematics Achievement Test (MAT) is used 
to determine mathematical achievement levels 
of students. The MAT was developed by the rese¬ 
archer (Ozsoy, 2011) and consists of 30 multiple 
choice questions. It includes numbers and ope¬ 
rations, geometry, measurement, and statistics 
questions; consistently with the curricula (MEB, 
2004). The maximum and minimum scores on 
the mathematics test could be 30 and 0, respec¬ 
tively. The validity of the questionnaire was as¬ 
sured by taking the views of three professionals 
about the relevancy of each item. Cronbach’s 
alpha reliability for the test was found to be r = 
.89 (M = 20.72, SD = 5.52). 

Data Analysis 

The data of the research were obtained at the end 
of the spring semester in 2011. All participants 
were assessed inside the classroom setting for 
a total about 1 hour in two different days. Then 
the data obtained were analyzed using ITEMAN 
and SPSS 15.0 software. Inferential statistics, 
independent samples t-test and ANOVA, were 
used to find out the relationships between the 
independent variables of gender and mathema¬ 
tical achievement levels and the scores obtained 
from MCI. Besides, Pearson correlation coeffi¬ 
cient is calculated to determine the correlation 
between MAT and MCI scores. Before using 
parametric tests, Kolmogorov-Simirnov test is 
conducted to check the normal distribution (for 
MCI, Z= 1.043, p > .01; for MAT, Z= 0.647, p > 
.01) and Levene test is conducted to check the 
homogeneity of the variances. 

The results of these analyses were reported to 
be significant at the p < .01 level statistical sig¬ 
nificance. To check whether the obtained sta¬ 
tistically significant results were also practically 
significant effect sizes were calculated. Eta squa¬ 


re (q 2 ) values were made to determine effect size 
values (Kotrlik & Williams, 2003). 

Results 

When the scores of participants are examined, it is 
observed that their mean prediction score is 26.00 
(SD = 11.60), average evaluation scores is 29.11 (SD 
= 10.65), and mean calibration scores is 55.11 (SD 
= 21.75). Depending on the results obtianed, it can 
be concluded that participants have medium-high 
level of calibration skills. To show whether there are 
significant differences between boys and girls with 
respect to their mathematical calibration skills, 
independent samples t-test was run. The results 
of the study showed that there were no significant 
differences between boys and girls with respect to 
their prediction scores (f= .88, p > .01), evaluation 
scores (f= .07, p > .01) and calibration scores (f= 
.50 ,p > .01). In order to examine, whether a signifi¬ 
cant relationship exists among students with diffe¬ 
rent mathematical achievement levels with respect 
to their mathematical calibration skills, ANOVA 
analysis was conducted. Before the analysis, stu¬ 
dents were grouped into three; as low, middle and 
high achievers, depending on their scores obtained 
from MAT. The results showed that there are sig¬ 
nificant differences between students’ calibration 
test scores with respect to their mathematical ac¬ 
hievement (E = 69.46, p < .001) with a large 
effect size (q 2 = .60). The post-hoc results showed 
the statistical significance exists among all groups; 
high achievers get higher scores (M= 77.58, SD= 
7.06) than middle achievers and low achievers and 
middle achievers (M= 54.27, SD= 16.70) get higher 
scores than low achievers (M= 26.15, SD= 13.49). 

Additionally a correlation analysis was conduc¬ 
ted to find out if participants’ scores obtained 
from MCI and MAT are significantly correlated. 
Results showed that high positive statistically 
significant relationships exist between students’ 
MAT scores and prediction scores r= .84 (p < 
.01); their MAT scores and evaluation scores r= 
.82 (p < .01); their MAT scores and calibration 
scores r= .85 (p < .01). 

Discussion 

One of the primary purposes of this study was 
to develop an instrument to measure primary 
school students’ mathematical calibration skills. 
Through the study a valid and reliable instru¬ 
ment; Mathematical Calibration Instrument, 
was developed. In order to name the instrument, 
“mathematical calibration” is used because ca¬ 
libration skills show discrepancies with respect 
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to related course or task (Winnie & Muis, 2011). 
In the literature, there is not any course/subject 
independent calibration instrument. 

Another purpose of this study was to determine 
students’ mathematical calibration skills and in¬ 
vestigating their calibration skills with respect to 
several variables by using the newly developed 
instrument. The developed instrument is applied 
to 94 fifth-grade students, the results showed that 
participants have a medium level of mathematical 
calibration skills. It is possible to argue that stu¬ 
dents’ calibration skill level is not sufficient con¬ 
sidering the importance of calibration in students’ 
achievement. Winnie and Perry (2000) reports that 
students with low calibration skills will fail to cont¬ 
rol their own learning process efficiently. Over¬ 
confident students do not change their study habits 
since they believe that they do not need to comple¬ 
te their missing knowledge. Underconfidence stu¬ 
dents do not try to change since they believe that 
they will always fail (Battistelli, Cadamuro, Farneti, 
& Versari, 2009). For this reason, it is important to 
self monitor and evaluate one’s own performance 
during learning process. 

Previous research studies showed that there is a 
significant relationship between mathematical 
calibration skills and mathematical achievement 
(Chiu & Klassen, 2010). It is known that students 
with high calibration skills perform mathematical 
tasks successfully during problem solving process. 
It is observed that, these students can easily control 
the problem solving process, solve complex prob¬ 
lems by separating simpler pieces, ask themselves 
questions to clarify their thoughts (Glenberg et al., 
1987; Dermitzaki, Leondari, 8c Goudas, 2009; Oz- 
soy & Ataman, 2009). 

One of the problems of the study was, to investi¬ 
gate how students’ calibration skills change with 
different variables. For this purpose, how calibra¬ 
tion skills change with gender differences is inves¬ 
tigated and it is found that there are no significant 
differences between boys and girls with respect to 
their calibration scores. This result is not consistent 
with the previous research studies (Connell & Ilar- 
di, 1987; Cole et al., 1999). In these studies, it was 
found that boys have more accurate predictions 
about their performances than girls. Similar re¬ 
sults obtained from studies focusing on university 
students’ calibration skills (Beyer, 1998). 

In the present study, the relationship between 
mathematical calibration skills and the mat¬ 
hematic achievement is also investigated. It is 
found that there is a positive and significant 
relationship between the students’ scores ob¬ 
tained from MCI and MAT. This result is ex¬ 


pected and supported by the related literature. 
According to Desoete et al. (2001) prediction 
and control skills explains 16% of mathematical 
achievement. Similarly, previous research (Bol & 
Hacker, 2001; Butler & Winne, 1995; Pajares & 
Miller, 1994; Pintrich &. de Groot, 1990; Ram- 
dass, 2009) has reported a relationship between 
mathematics achievement and mathematical 
calibration skills. Research studies focusing on 
calibration shown that calibration has a signifi¬ 
cant impact on students’ achievement, thus stu¬ 
dents with higher levels of calibration skills are 
more successful than students with lower levels 
of calibration skills. For this reason, studies imp¬ 
roving students calibration skills can be used as 
useful toold for their development. 
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